Papers with parameter prediction
UniToolBench: A Benchmark for Tool-Augmented LLMs in Cross-Domain, Universal Task Automation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing benchmarks that focus on manually curated tool graphs lack scalability and diversity across domains. |
| Approach: | They propose a large-scale, cross-domain benchmark to evaluate LLMs' ability to reason over and utilize interconnected tools for automation. |
| Outcome: | The proposed benchmark incorporates automated tool graph construction by formulating link prediction as a probabilistic task, instead of relying on categorical LLM outputs. |